Excited against the tide: 
A random walk with competing drifts 
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Abstract 

We study a random walk that has a drift ^ to the right when located at a previously 
unvisited vertex and a drift 4 to the left otherwise. We prove that in high dimensions, for 
' every /i, the drift to the right is a strictly increasing and continuous function of 0, and that 

there is precisely one value Po(n,d) for which the resulting speed is zero. 
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1 Introduction 



In this paper we study what might be called an excited random walk with drift (ERWD), where the 
■ random walker has a drift § in the positive direction of the first component each time the walker 
visits a new site, and a drift 4 in the negative direction of the first component on subsequent visits. 
Models of this type with drift for a fixed finite number of visits to a site have been studied by 
^ \ Zerner and others, usually in 1 dimension, see for example [H EJ El [T7] . They are generalisations 
O ■ of the excited random walk introduced in [1] . 

It is known that excited random walk has ballistic behaviour when d > 2 in [H [13], [H] , while 
^ . there is no ballistic behaviour (when (3 < 1) in one dimension [7]. Laws of large numbers and 
central limit theorems can be obtained for d > 2 using renewal techniques (see for example [16J, 
|17j . [5]). Intuitively, the velocity appearing in the laws of large numbers should be increasing in 
the excitement parameter, (3. This has been proved in dimensions d > 9 [TT] using a perturbative 
expansion developed in [TO] , but the problem remains open for d < 9. Using the same expansion 
approach it is possible [12] to prove monotonicity for the first coordinate of the speed of random 
walk in a partially random i.i.d. environment, in the special case where at each vertex, either the 
left or the right step is not available. 

We use the same argument in this paper, together with the law of large numbers provided 
by [6J Theorem 1.4] to prove that for d > 12, for each fixed fi > the speed in the direction of 
the positive first coordinate is continuous and strictly increasing in (3. We give an easy coupling 
argument showing that the speed is negative when (3 is sufficiently small (depending on /i and d) 
and show that when d > 9 the speed is positive when (3 is sufficiently large. We conclude that 
when d > 12, for each /i > there is exactly one value /3o(fi, d) of (3 for which the speed is zero. 
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Although we only consider the once-excited random walk with all subsequent visits having a 
reverse drift, many of the results of this paper will remain valid under appropriate relaxations of 
these conditions, e.g. multi-excited random walks with a reverse drift only after the kth visit to a 
site, or random walks in site-percolation-like cookie environments. It may also be possible (using 
the approach in [TTl fl~2] and this paper) to prove monotonicity in p for the speed of excited random 
walk in a site-percolation (parameter p) cookie environment in high dimensions. 



1.1 Main results and organisation 

A nearest-neighbour random walk path 77 is a sequence {r]i}°l for which r\i G Z d and 771+1 — 77; is a 
nearest-neighbour of the origin for all % > 0. For a general nearest-neighbour path 77 with 770 = 0, 
we write p Vi (xi, sCj+i) for the conditional probability that the walk steps from rji = Xi to Xj+i, given 
the history of the path rji = (770, . . . , r/j). We write u n for the n-step path of excited random walk 
with opposing drift (ERWD) and Q for the law of {ccv}^L , i.e., for every n-step nearest-neighbour 
path ff n , 

n-l 

Q&n = ffn) = J] PHVuVi+l), (1-1) 
i=0 

where, for i — 0, p°(0, 771) = (2d) _1 (l + /fei ■ 771) is the probability that the first step is to 77!, and 

P Wt ' /? J 2d 2rf ' 

Here ei = (1, 0, . . . , 0), and a: • y is the inner-product between x and 7/. It is always the case that 
our walks take nearest-neighbour steps, although this is not made explicit in the notation. We are 
interested in the velocity/speed/ drift Vi(d, j3, n) of the first coordinate of the random walk, defined 
by 

Vl = lim -2-, (1.3) 

whenever this limit exists. Here x^ denotes the first component of x E 7L d . 

The main result of this paper is the following theorem, which is proved in Section [5j 

Theorem 1.1 (Monotonicity of the speed). The velocity vi(d,/3,/i) for ERWD in dimension d is 
continuous for (j3, p) € [0, l] 2 when d > 6 and is strictly increasing in [3 G [0, 1] for each p G [0, 1] 
when d > 12. 

In fact we show that the partial derivative of v\ with respect to j3 exists and is positive when 
d > 12. It is also possible to prove monotonicity in f3 for (3 + p sufficiently small when d > 8, and 
for all p G [0, 1] (resp. (5 G [0, 1]) and (3 (resp. p) sufficiently small when d > 9. 

In order to establish Theorem II .11 we first need to establish that the limiting velocity V\ actually 
exists. Although this can be achieved for d sufficiently large using the expansion of [TU], we can 
appeal to the ergodic method of [B|, for which it is sufficient that d > 6. The following result is 
established in [6], Theorem 1.4] in the context of random walk in a random environment, however 
the same argument works for ERWD, and in fact much more generally (e.g. i.i.d. random multi- 
cookie environment). 

Theorem 1.2 (see Theorem 1.4 of [6]). For each d>6 and (p, /3) G [0, l] 2 , there exists v(d,p,/3) 
such that Q(v = lim^oo n~ l u) n ) = 1. 
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Sign of velocity of ERW in 2 dimensions 
with competing drifts beta and mu 



Sign of velocity of ERW in 3 dimensions 
with competing drifts beta and mu 
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Figure 1: Estimates of the sign (+,-) of the velocity V\ of ERWD in 2 and 3 dimensions, based on 
1000 simulations of 7000-step walks, done in R |15j . 

In [6] there exist well-behaved random cut times (independent of the environment) with the 
property that the set of sites visited before and after each cut-time are disjoint. Thus one can 
essentially lay down a new i.i.d. environment at each of these cut-times. The equivalent notion in 
the present context, would be to replace all of the cookies at these cut times since none of the sites 
with missing cookies at a cut time will be visited again anyway. The following Lemma is proved in 
Section [2] using an elementary "cookie replacement" coupling argument and implies that for d > 6 
and each fi > we can choose (3 sufficiently small so that the velocity is negative. 

Lemma 1.3. For each d > 2 and each \i > there exist 5 > and (3*(fi,d,5) > such that for 

[i] 

every (3 < f3*, Q(limsup n ^ 00 ^ < -S) = 1. 

Lemma 11.31 implies transience of uj\^ for d > 2 and (3 < /?*, whence renewal techniques (e.g. 
j5j [HI [T7]) may be used to prove the existence of the velocity. In high dimensions the formula for 
the velocity in [10], shows that the velocity is positive for (3 sufficiently large. 

Lemma 1.4. For each d > 9 and each ji > there exists {3*([i, d) > such that for every [3 > [3* , 
Q(lim n _ oo ^>0) = l. 

Lemmas 11.31 and 11.41 together with Theorem 1 1 . 1 1 1 hen immediately imply the following result. 

Corollary 1.5. For each d > 9 and each /i£ [0, 1] there exists a (3q{^l, d) G [0, 1] for which v = 0, 
i.e. Q(lim n ^ 00 — = 0) = 1. For each d > 12 and \x G [0, 1] there is a unique such j3o(n, d). 

Apart from Lemma 11.31 all of the above results are proved in this paper in high dimensions 
only. We expect the results to hold for all d > 2, with the exception that Lemma [L~4l may not hold 
for fi close to 1, when d = 2. See Figured! 
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Conjecture 1.6. For all d > 2, (/x, (3) G [0, l] 2 the velocity v\ = lim^oo n -1 ^ 1 ' exists and is 
monotone increasing in (3 for fixed /i and decreasing in \i for fixed (3 respectively. For each d > 3 
and /i G [0, 1] there exists a unique /5o(/i, d) G [0, 1] such that v(d,/A,flo) = 0. 

It would also be interesting to know whether the first coordinate of the walk is recurrent when 
(3 = (3q. Perhaps this can be verified when d > 14 using P, Theorem 2.2]. 

The remainder of this paper is organised as follows. We prove Lemma 11.31 in Section [2j In 
Section [3] we give a formula for the speed of ERWD when d > 6, and verify Lemma [T~4l In Section 
H] we consider the derivative of this formula, and estimates of this derivative are used in Section [5] 
to prove Theorem ll.il 



2 Proof of Lemma 1.3 



Fix d > 2 and /i > 0. We prove that for (3,5 > sufficiently small depending on \x and d, 
limsup n ^ 00 n _1 u4^| < —5 almost surely. We do this by comparing the ERWD with a similar model 
where all of the eaten cookies are replaced at times 3m, m G N. Perhaps the results in this section 
can be improved by replacing all of the cookies at times km for k > 3. 

Let E C Z d (resp. E~ x C Z d \ {x}) denote a cookie configuration, i.e. a set of vertices in Z d 
(resp. Z d \{x}) at which cookies are present. Let A x = {l—ji+((3+^)I x ) and B x = (l+/x— ((3+ji)I x ), 
where I x is the indicator that there is a cookie at x. Then < A X ,B X < 2, A x + B x = 2, A x is 
increasing in I x and B x is decreasing in I x . Let Qe denote the law of an ERWD if with a given 
initial cookie configuration E C and write x ~ y (resp. x ~~ y) if x is a neighbour of y (resp. 
x is graph distance 2 from y). Then we have 



(2d) 3 Q E (4 ] = 3) =A A ei A 2ei 

(2rf) 3 Q s (4 1] =2)=A A ei (2rf-2) + Ao J2 A u+ E 



(2d) 3 Q i? (4 1] = 1) =A A ei B 2ei + 4)£ ei (l - fi) + B A_ ei (l - //) + A (2rf - 2) 2 + 

E A u (2d - 2) + (2d - 2)(1 - fi) + E A - 

(2rf) 3 Q s (4 1] = -3) =B B_ ei B_ 2ei 

(2rf) 3 Q i; (4 11 = -2)= J Bo5 ei (2d-2) + J B £ 5 U + £ AA +ei 

(2rf) 3 Q s (4 1] = -1) =B B^ ei A„ 2ei + B A- ei {l + n) + A B ei {l + + B (2d - 2) 2 + 

E 5 u (2rf-2) + (2d-2)(l + A i)+ £ fl„ 

u~0:w^±ei u~~0:u-ei=0 

(2d) 3 Q s (4 1] = 0) =1 - E above terms ( 2 - 9 ) 

It is easy to see that (12. ip and (12.21) are non-decreasing in I x for every x, for any fixed cookie 
environment E~ x C Z d \ {x}, and that Qsiv? > 0) =<^+§I^+§2M+ < B) is nondecreasing in 
/a, for x {0, ei} and any fixed Simple arithmetic enables us to write 

Qe(v 1 3 ] > 0) =A K (E-°) + K' (E~°) = A ei Ki(E~ ei ) + ^(-E" 61 ), (2.10) 



2.1 
2.2 



2.3 
2.4 

2.5 
2.6 

2.7 
2.8 



4 



where Kq,K' q > (resp. K±,K[ > 0) are constants that depend on £ but not Iq (resp. E ei 
but not I ei ). This verifies that (12 . 1 p + (12 . 21) + (12 . 31) + (12 . 4p is nondecreasing in I x for each x, and each 
fixed E~ x . Similarly, (B^ji . (|2T6|) and (|2^ + (l2"3j) + (p?7p + (j2T5p are nonincreasing in I x for each x, 
E~ x . 

It follows that we can define random walks Q and V on the same probability space so that Co 
has the law of ERWD and where v is the sum of independent random vectors Xi, each with the 
distribution of u 3 (corresponding to the situation above with I x = 1 for all x), and such that the 
following hold 





~ W 3(n-1) 


= 3 = 




^3(n-l) 


= 3, 




- u [1] - 


-3 = 


> ^3n 






-3, 




~ U 3{n-1) 


= 2 = 




^3(n-l) 


>2, 


v 3n 


U 3(n-1) — 


-2 = 


> ^3n 


J 1] 
~ W 3(n-1) 


< 


-2, 


^3n 


~ W 3(n-1) 


= 1 = 




^3(n-l) 


> 1, 


v 3n 


U 3(n-1) — 


-1 = 


> ^3n 


~ U 3(n-1) 


< 


-1. 



In particular, under this coupling, u^—uo^ is non-negative and non- decreasing in n, almost surely. 

Since n~ l J2?=i Xi — > E^] almost surely, and E[a;| ] is continuous in (3, it is enough to prove 
that E[a>3^] < when (3 = 0. In this case A x = B x = 1 for each x so we can use (I2.1I) -( |2T81) to get 
(2c?) 3 E[u4 1] ] = -idfi < when (3 = as required. □ 

Note that by keeping track of the (3 dependence in (I2.1l) - (l2.8p . one can get an explicit bound 
on how small (3 should be as a function of fi and d. 



3 The formula for the speed 



We recall some notation and results from [10] and [IT] giving an expression for the velocity v of 
the ERWD. If fj and u are two paths of length at least j and m respectively and such that rjj = uj , 
then the concatenation fjj o uj m is defined by 



rji when < i < j, 

when j < i < m + j. 



(3.1) 



Given ff m such that Q(u; m = ff m ) > 0, we define a conditional probability measure Q Vm on walks 
starting from r\ m by 



•mm. 



n-1 
i=0 



Set j = 0, and for N > 1 let 



At tu ■ ,i oo; . 

N = [p w 



For ERWD, A^ is non-zero precisely when lo^ has already been visited by u;j™ but not by 



w „ \/ (iV) (JV) \ 



(3.2) 



(3.3) 



(JV-l) 



so that 



Jjv- 



JJV 



2d 



IA K^ + ^r 

I^Avl S — ir ,(JV) _, ,(JV) 



L 1»r > 1»r i liv-lJ L JJV ^ JJV 



JJV JJV-1 JJV" 



and 



^7 x f { J " ) I JV I , 1 J. r (JV) ^(JV-1)! 

Zffl 1 JJV+ 1 3 JV J 1 JJV 3JV-1 J 



(3.4) 
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Define A m , N = {(ji, • • • ,j N ) <E Z+ ■ J2i=i ji = m - N - 1}, A N ={J m An,* and 



(3.5) 

Note that this quantity depends on /3, li, and <i, as do the following 

oo oo 

i: m {x,y)^Y,< ) ^y), ^ N \x,y):=j:<V(^y), and n m (y) := E E V)- (3-6) 

iV=l m N=l x 

In [TU], it was shown that if lim^oo J2m=2 X7r m( x ) exists and n~ x uj n — > v in probability, then 

oo 

w(/5,/i,d) = EV(0,x)+ EE CT ™W ( 3 - 7 ) 

x m =2 a; 

(3.8) 

a m=2 N=l x,y 

Let Prf denote the law of simple symmetric random walk in d dimensions, beginning at the 
origin, and let Dd(x) = (2d)~ 1 I{\ x \=iy be the simple random walk step distribution. For absolutely 
summable functions /, g on Z d , define the convolution of / and g by 

(f*9)(x)=Y,f(y)9(x-y). (3.9) 

y 

Let f* k {x) denote the fc-fold convolution of / with itself, and let Gd(x) = Y^kLo ^*di. x ) denote the 
Green's function for this random walk. Then G^ k (x) < oo when d > 2k. Define G* k = G^ h (0). 
For % > and d > 2(i + 1) + 1 define 

sM)={-^) l+1 GtX 1] -i- (3-10) 

For d > 5 define 

a d = _ ^ 2 Gf_ v (3-11) 

The following proposition is proved exactly as in the proof of [TT| Proposition 3.2] with (3 
replaced by (3 + li in each of the bounds. 

Proposition 3.1 (Bounds on the expansion coefficients). For all N > 1, 

TT\*™(x v)\ < IW + ti*- 1 *® N = 1 > (3 12) 

1 j ' - \{P + ») N dr\d-\)-iG^M*)(*i) N -* N>1. [ " ] 

Since the speed is known to exist when d > 6 by the ergodic argument of [B] (see Theorem 
11.21) . the following corollary is an easy consequence of [TQl Propositions 3.1 and 6.1] together with 
Proposition 13. 1\ and the fact that 2a 6 < 1 since Gf < 25/12 [9]. 
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Corollary 3.2. For all d > 6 and /3,/x G [0, 1], 



«p, °° o oo oo 

G m=2 a; fl AT=1 m=2 x,y 

Proof of Lemma\1.4\ Corollary 13.21 implies that for d > 6, 



(3.13) 



<EEE»,y)|. 

JV=1 m 



(3.14) 



Thus to prove the lemma, it is sufficient to show that there exists S > independent of (3 such 
that ^E??=i Ei.y E m l 7r m ) ( a ') v)\ < 1 — ^- From Proposition 13.11 we have 



rfEEEK 1 (^)l<2W+4 



Gd-i£i(d) 
(d-l)(l-2a d ) 



(3.15) 



and since the right hand side is independent of /x and /3 and decreasing in d, it is enough to prove 
that it is less than 1 when d = 9. This result can easily be checked using the rigorous upper 
bounds G 8 < 1.07865 and Gf < 1.28901 0(9]. 

□ 



4 The differentiation step 



We follow the analysis in [TT] . We fix /x G [0,1], differentiate the right hand side of (13.81) with 
respect to /3, and prove that this derivative is positive for all (3 G [0,1], when d > 12. Letting 



(p^P(x,y) = ■$p'Kl% ) (x,y) and assuming that the limit can be taken through the infinite sums, we 
then have 



oo oo 



+ E EEfe-^tf(^). 

JV=1 m=2 x,y 



(4.1) 



Since tpffi(x, y) = unless |x — y| = 1, we have that 



dv 1 
~dj3 



< EEEItt»)l- 



(4.2) 



JV=1 m=2 



We conclude that ^ is positive when X)jv=i Em=2 X^,?/ l < ^m ) ( a: ) < To verify the exchange 
of limits in (14. II) . it is sufficient to prove that Y.x,y(y ~ x )' K m ) i. x ^y) is absolutely summable in m 
and N and that J2n=i Em=2 su P/3,/ie[o,i] I ^2x,y(y ~ x )9 J m ) ( x 5 y)\ < °°- By Proposition 13.11 and the 
fact that \y — x\ — 1 for x, y nearest neighbours, the first condition holds provided that 



{(3 + fi)a d < I. 



(4.3) 



In fact we shall see that this inequality for (3 = /x = 1 is also sufficient to also establish the second 
condition. We now identify tp^ix, y). 



7 



It follows from (13.51) that 

<P%>(*,V) = V^fov) + <P% A (*,V) + <P% A (?,V), (4-4) 
where (by Leibniz' rule), ip^-^^x, y), <p!£ ,S) (x, y) and <p^' 3) (x, y) arise from differentiating p°(0, w^), 

-*(n— 1) -*('"•) / \ . 

ULiUt^P^-^y ("£>£u) and llti n£S! respectively. 
Observe that if ff m = xi then 

= {Xl ^- l} (l { ,- Xl =e l} ~ /{.-.,=-«}) , (4-5) 

and hence, using I a — Iadc — Iac\C c we have 
d - 1 

— {p} m {x h X) - Pp n ° Vm (x h x)) = ^Iixrfnm-X^eZn-x} ( J {*-*I=ei} - hx-*l = -ei}) ■ ( 4 -6) 



Clearly then 
d 



d - 1 

— (p} m {x U X) - p^° , ' m (x i , X)) < ^Iixt&Sn-^rU-i} ( J {^^=ei} + J{*-*»=-ei}) ■ (4-7) 

Let p (N) be obtained by replacing p°(0,o; 1 0) ) in (13.51) with (2c£) (o)_, i (a bound on its 
derivative) and by bounding A^ by | A^l for all n = 1, . . . , N. 

For k = 1, . . . , N, let 7^ be obtained from (13.51) by bounding A^ by |Ajv| for all n — 1, . . . , N 

and by replacing 11^=0 p^^- 1 ^ "^ ,uf^ +1 \ with the following bound on its derivative 

e U+1 2 ; } n (4.8) 

Similarly, let Xk° be obtained by replacing A}J +1 in d22J by (2d) -1 / (fe) (fe -i) (fc) J (fc) « , , 

(a bound on its derivative) and by bounding A n for n 7^ k by |A„|. 
Letting T W = Ef=i and x (JV) = Ef=i xf: we obtain that 

EEIv«^)I<p (jv) , E£l#°fov)l<7 (w \ and EEie 3, fei/)l<r. (4.9) 

m x,y m x,y m x,y 

Define 

^> = (I^ G - G ?-, + ^G?-, (4-10) 

The following proposition is proved exactly as in Corollary 4.5 of [11] except that we replace j3 
with /3 + \i in all of the bounds. 

Proposition 4.1 (Summary of bounds). For all /3,/jL G [0, 1], and d suc/i that 2ad < 1, 

d V p (JV) < 2g °^ + 4G d _ 1 g 1 (d) 
jfe rf d(d-l)(l-2a d ) 



j (N) tj\ , 2G d _i^i(d)(2 - 2a d ) , . 

d Lr J <£o(d) + : T2- (4-12) 

iv=i (d-l)(l-2a (i ) 



» (JV) gdgti 4e(d)d l^djG^Gg^ 
" E7 -(^ + (r^) + (d-l) 4 (l-2a,f (413) 



AT=1 
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5 Proof of Theorem 



1.1 



Continuity of V\ as a function of \i and (3 follows from the fact that the formula for the speed 
is a sum of functions that are continuous in /i and (3 and absolutely summable, uniformally in 
(//, (3) G [0, l] 2 by Proposition 13.11 and the fact that 2a^ < 1 for d > 6. 

For d > 6, the bounds of Proposition 14.11 hold. From (14.91) we have the required absolute 
summability conditions in the discussion after (14. ip . and in particular (14.11) holds for all (3. To 
complete the proof of the theorem, it remains to show that the right hand side of (14 .2p is no more 
than d . By ( 14. 9 p and Proposition 14.11 we have bounded d times the right hand side of (14.21) by 
the sum of the right hand sides of the bounds in Proposition 14.11 Since these terms all involve 
simple random walk Green's functions quantities, we will need to use estimates of these quantities. 

By Lemma C.I], d i— > G™ is monotone decreasing in d for each n > 1, so that it suffices to 
show that the sum of terms on the right hand sides of (14. lip . (14.121) and (14.131) is bounded by 1 
for d = 12. For this we use the following rigorous Green's functions upper bounds [HIS]: 

Gn(0) < 1.05314, G* 2 (0) < 1.18018, G^(0) < 1.43043. (5.1) 

Putting in these values we get that the sum of the right hand sides of the bounds in Proposition 
IQis at most 0.847, for d > 12. 

□ 

Acknowledgements. This work was supported in part by a FRDF grant from the University of 
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bounds. 
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